MPI-IO: A Standard, Portable API for High-Performance Parallel I/O
نویسندگان
چکیده
MPI-IO, the I/O part of the MPI-2 standard, is a portable API for high-performance parallel I/O. It is speci cally designed to overcome the performance and portability limitations of the Unix-like APIs currently supported by most parallel le systems. We discuss the main features of MPI-IO and describe our MPI-IO implementation, ROMIO, which runs on most machines and le systems, including Linux clusters. We also explain how MPI-IO must be used in order to achieve high I/O performance.
منابع مشابه
Parallel I/o
Many parallel applications need to access large amounts of data. In such applications, the I/O performance can play a significant role in the overall time to completion. Although I/O is always much slower than computation, it is still possible to achieve good I/O performance in parallel applications by using a combination of a sufficient amount of high-speed I/O hardware, appropriate filesystem...
متن کاملI/O in Parallel Applications: the Weakest Link
Parallel computers are increasingly being used to run large-scale applications that also have huge I/O requirements. However, many applications obtain poor I/O performance on modern parallel machines. This special issue of IJSA contains papers that describe the I/O requirements and the techniques used to perform I/O in real parallel applications. We rst explain how the I/O application program i...
متن کاملEfficient Parallel I/O on SCI Connected Clusters
efficient use of the underlying SCI interconnect is presented. Every process of the MPI application is client as well as server for I/O operations. This allows for a maximum of locality in file access, while the accesses to remote portions of the distributed file are performed via distributed shared memory techniques. A server is only required to manage the initial distribution of the file frag...
متن کاملPortable Implementations File - System - Specific Implementations ADIO SIO low - level API
In this paper, we propose a strategy for implementing parallel-I/O interfaces portably and eeciently. We have deened an abstract-device interface for parallel I/O, called ADIO. Any parallel-I/O API can be implemented on multiple le systems by implementing the API portably on top of ADIO, and implementing only ADIO on diierent le systems. This approach simpli-es the task of implementing an API a...
متن کاملTopic 18: Parallel I/O and Storage Technology
Input and output (I/O) is a major performance bottleneck for large-scale scientific applications running on parallel platforms. For example, it is not uncommon that performance of carefully tuned parallel programs can slow dramatically when they read or write files. This is because many parallel applications need to access large amounts of data, and although great advances have been made in the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1999